Technology for combining images in a form

ABSTRACT

When a plurality of image data are received, a form data from among at least one form data and a format data from among at least one format data are selected based on number of the image data. The image data, selected form data and format data are combined to generate an output image.

CROSS-REFERENCE TO RELATED APPLICATIONS

The present document incorporates by reference the entire contents ofJapanese priority document, 2004-266676 filed in Japan on Sep. 14, 2004.

BACKGROUND OF THE INVENTION

1. Field of the Invention

The present invention relates to a technology for combining image dataand format depicting data.

2. Description of the Related Art

Digital still cameras have become very popular. In these digital stillcameras, photographed digital images are stored in a recording mediumsuch as a memory card.

When printing the photographed digital images, the digital still camerais connected to an external device, such as a personal computer, and thephotographed digital images are transmitted to the external device. Thephotographed digital images are then printed by a printer attached tothe external device.

However, the job of connecting a digital still camera to a personalcomputer, transferring the photographed digital images from the digitalstill camera to the personal computer, connecting a printer to thepersonal computer, and operating the personal computer to print thephotographed digital images on the printer is not an easy job for acommon man. To make the printing process easy, there has been developeda technology in which a digital still camera can be directly connectedto a printer.

Japanese Patent Application Laid Open Nos. H11-8831, 2000-71575,2002-16833 disclose various techniques for printing images with orwithout using a personal computer.

In some conventional digital still cameras it is possible to insertimages into spaces prepared in a template form. However, when the numberof images to be printed does not match with the spaces in the form, anundesirable result is obtained. For example, when the spaces are moreand the images to be printed are less, some of the spaces remain blank.

SUMMARY OF THE INVENTION

It is an object of the present invention to at least solve the problemsin the conventional technology.

An image processing device according to one aspect of the presentinvention includes a storing unit that stores at least one form data, aplurality of image data, and at least one format data; a selecting unitthat selects a form data and a format data from among the form data andthe format data stored in the storing unit based on number of imagedata; and an image combining unit that combines the image data, selectedform data and format data to generate an output image.

A method of combining an image and a form according to another aspect ofthe present invention includes comprising receiving a plurality of imagedata; selecting a form data from among at least one form data and aformat data from among at least one format data based on number of theimage data; and combining the image data, selected form data and formatdata to generate an output image.

An image forming device according to still another aspect of the presentinvention a storing unit that stores at least one form data, a pluralityof image data, and at least one format data; a selecting unit thatselects a form data and a format data from among the form data and theformat data stored in the storing unit based on number of image data; animage combining unit that combines the image data, selected form dataand format data to generate an output image; and an outputting unit thatoutputs the output image.

A printing system according to still another aspect of the presentinvention an image capturing unit configured to capture images; and aprinting unit. The printer unit includes a storing unit that stores atleast one form data, a plurality of image data corresponding to imagescaptured by the image capturing unit, and at least one format data; aselecting unit that selects a form data and a format data from among theform data and the format data stored in the storing unit based on numberof image data; and an image combining unit that combines the image data,selected form data and format data to generate an output image; and anoutputting unit that outputs the output image.

The above and other objects, features, advantages and technical andindustrial significance of this invention will be better understood byreading the following detailed description of presently preferredembodiments of the invention, when considered in connection with theaccompanying drawings.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 is a block diagram of a digital still camera printing systemaccording to an embodiment of the present invention;

FIG. 2 is a detailed block diagram of a digital still camera shown inFIG. 1;

FIG. 3 is a detailed block diagram of a printer shown in FIG. 1;

FIGS. 4A to 4D are examples of form data;

FIGS. 5A to 5D are schematics of a layout, form data, images, and acombined image;

FIG. 6A is a schematic for explaining the concept of a rotation angle;

FIGS. 6B to 6D are schematics for describing variable size modes;

FIGS. 7A to 7D are schematics of depicting data of form additional data;

FIG. 8 is a schematic of a combined document created according to theembodiment; and

FIG. 9 is a flowchart of a printing processing performed by the printer.

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

Exemplary embodiments of the present invention will be described belowwith reference to accompanying drawings. The present invention is notlimited to these embodiments.

FIG. 1 is a block diagram of a digital still camera printing system 50according to an embodiment of the present invention. The digital stillcamera printing system 50 includes a digital still camera 100 that takesdigital images, and a printer 200 that prints the digital images.

The digital still camera 100 and the printer 200 are capable ofcommunicating with each other using a protocol and a data format thatare compliant with the PictBridge standard established by the Camera &Imaging Products Association (CIPA) as DC-001-2003 Digital PhotoSolutions for Imaging Devices.

FIG. 2 is a detailed block diagram of the digital still camera 100. Inthe digital still camera 100, a system control unit 1 controls: eachunit of the digital still camera 100; writing/reading of data to/from arecording medium 30; photographing; and communication between anexternal device via an external communication unit 9. Furthermore, thesystem control unit 1 performs various data processings, such as userinterface processings when a user operates the digital still camera 100.A system memory 2 stores various control programs executed by the systemcontrol unit 1, and is used as a work area of the system control unit 1.A parameter memory 3 stores various data specific to the digital stillcamera 100, and a clock circuit 4 outputs the present time.

A reader/writer 5 is used to write/read data to/from the recordingmedium 30. A photographing unit 6 includes a camera mechanism used forphotographing, an optical system, and a photoelectric converting unit. Adisplay unit 7 displays various data to a user on a liquid crystaldisplay. An operating unit 8 has various keys that a user can use whenoperating the digital still camera 100.

An external communication unit 9 connects the digital still camera 100to an external device, such as the printer 200. As a result, the digitalstill camera 100 can exchange data with the external device via theexternal communication unit 9. The external communication unit 9 can bea versatile communication unit such as a USB.

The system control unit 1, the system memory 2, the parameter memory 3,the clock circuit 4, the reader/writer 5, the photographing unit 6, thedisplay unit 7, the operation unit 8, and the external communicationunit 9 are connected to each other by an internal bus 10. As a result,data can be exchanged between any two or more units via the internal bus10.

FIG. 3 is a detailed block diagram of the printer 200. In the printer200, a system control unit 21 controls: each unit of the printer 200;paper feeding; printing; and communication between an external devicevia an external communication unit 28. Moreover, the system control unit21 performs various data processings, such as user interface processingswhen a user operates the printer 200. A system memory 22 stores variouscontrol programs executed by the system control unit 21, and is used asa work area of the system control unit 21. A parameter memory 23 storesvarious data specific to the printer 200, and a clock circuit 24 outputsthe present time.

A page buffer memory 25 stores printing data of one page, a print unit26 prints an image onto paper, and an operation display unit 27 is auser interface for a user to operate the printer 200.

The external communication unit 28 connects the printer 200 to anexternal device, such as the digital still camera 100. As a result theprinter 200 can exchange data with the external device via the externalcommunication unit 28. The external communication unit 28 can be aversatile communication unit such as a USB.

The system control unit 21, the system memory 22, the parameter memory23, the clock circuit 24, the page buffer memory 25, the print unit 26,the operation display unit 27, and the external communication unit 28are connected to each other by an internal bus 29. As a result, data canbe exchanged between any two or more units via the internal bus 29.

FIG. 4A is an example of form data stored in the printer 200. Theprinter 200 stores a plurality of such form data.

The form data includes image combining data and form additional data.The image combining data indicates how image data is to be laid out on apage. The form additional data includes depicting elements to be addedto the page. There are two types of depicting data: a depicting elementthat is added to image data laid out on a page (image-associatedadditional-depicting-data), and a depicting element that is always addedto a fixed position on a page (fixed additional-depicting-data).

As shown in FIG. 4B, the image combining data includes number of images(N) on one page of a form that is created by the form data, and layoutdata #1 to #N defining a position of each of the images. As shown inFIG. 4C, each layout data includes a depicting reference position, adepicting size, a variable size mode, and a rotational angle.

In an example shown in FIG. 5A, there are two display frames FL1 and FL2for laying out images on a page that is created by the form data. Thus,the image combining data includes two sets of layout data #1 and #2,corresponding to display frames FL1 and FL2. The layout data #1 includesa coordinate value of a point P1 at the top left corner in display frameFL1 as the depicting reference position, and a height H1 and a width W1of the display frame FL1 as the depicting size. Moreover, 0 (zero)degrees is stored as the rotational angle, and “keep aspect ratio” isstored as the variable size mode.

FIG. 6A is a schematic for explaining the concept of the rotationalangle. The rotational angle is an angle around a reference point P in aframe FL. A rotational angel in an anti-clockwise direction isrepresented by a positive value, and a rotational angel in a clockwisedirection is represented by a negative value.

There are two types of variable size modes: “keep aspect ratio (ratio ofheight and width)”; and “fit in display frame”. FIG. 6B is a diagramshowing an example of fitting a foreground image PT into the displayframe FL that is smaller than the foreground image PT. When the “keepaspect ratio” mode is set, as shown in FIG. 6C, a reduced image PTa ofthe foreground image PT is fit into the display frame FL by retainingthe aspect ratio. Specifically, the height is reduced to match that ofthe display frame FL, and the width is reduced correspondingly so thatthe reduced image PTa has the same aspect ratio as the foreground imagePT. On the other hand, when the “fit in display frame” mode is set, asshown in FIG. 6D, a reduced image PTb of the foreground image PT isreduced into the same size as the display frame FL. Specifically, boththe height and the width are reduced to match that of the display frameFL.

As shown in FIG. 4D, the form additional data includes a characterdepicting data group, a line depicting data group, a graphic depictingdata group, and an image depicting data group.

The character depicting data group includes an Nc number of characterdepicting data. The character depicting data is sorted in an ascendingorder of an image index value.

The line depicting data group includes an Nr number of line depictingdata. The line depicting data is sorted in an ascending order of animage index value.

The graphic depicting data group includes an Ng number of graphicdepicting data. The graphic depicting data is sorted in an ascendingorder of an image index value.

The image depicting data group includes an Ni number of image depictingdata. The image depicting data is sorted in an ascending order of animage index value.

The image index value is a value for referring to an image correspondingto the layout data in the image combining data. For example, an imageindex value 1 means that the data (image-associatedadditional-depicting-data) is added to a position associated to an imageaccording to layout data #1. An image index value 0 means that the datais not associated to an image (fixed additional-depicting-data).

As shown in FIG. 7A, the character depicting data includes a printingposition that is a position where a character string is to be printed ona form (character reference position coordinate), a size, a font, style(bold, italic, etc.), a color, the character string, and an image indexvalue. For example, in form data shown in FIG. 5B, the character string“P/” at the top right corner are depicted according to characterdepicting data #1 (image index value:O). This character string isindicated by a value “P pp/PP”; “pp” indicates a page number and “PP”indicates a total number of pages.

As shown in FIG. 7B, the line depicting data includes a depictingposition on a form (depicting reference position), length, lineintervals, thickness of lines, color of lines, number of lines, and animage index value. For example, in the form data as shown in FIG. 5B,there are two spaces for laying out images, and lines are provided atpositions associated to each space, so that a user can write in a memo.These lines are depicted according to line depicting data #1 (imageindex value: 1) and line depicting data #2 (image index value: 2),respectively.

As shown in FIG. 7C, the graphic depicting data includes type ofdepiction (assembly of lines/bezier curve), method of depiction (lineonly, fill (even-odd rule, non-zero winding rule), line and fill), linecolor, line thickness, color of fill, a depiction position (assembly ofdepiction positions, including control point in the case of beziercurve), and an image index value.

As shown in FIG. 7D, the image depicting data includes a depictingposition on a form (depicting reference position), a width and a heightof a source image, a width and a height of a depicted image, number ofcolors (monochrome, 256 colors, full-color), data size, image data, andan image index value.

The form data shown in FIGS. 5A to 5D includes two spaces for images onone page. When a user selects three images, the first page including twoimages is printed out, as shown in FIG. 5D.

The second page is printed out as shown in FIG. 8. Specifically, thethird image is positioned at the space for a first image on the page,and lines are depicted at a position associated to the image. Moreover,the space for a second image on the page is left blank, without anylines depicted.

According to the embodiment, when a page is created according to formdata, and the page has a blank space because there are more spaces thanthe number of images selected for printing, depicting elements(characters, lines, graphics, etc.) associated to the blank space arenot printed. Thus, unnecessary form elements are omitted, so that adesirable output is obtained. Moreover, unnecessary consumption of colormaterial of the printer 200 (toner, ink, etc.) is suppressed.

FIG. 9 is a flowchart of a printing processing performed by the printer200. In this printing processing, a plurality of images selected by auser is transferred from the digital still camera 100 to be printed outon one page.

A user is made to select a form data (step S101). Operation guidance anda list of form data can be displayed on the operation display unit 27 tofacilitate the selection.

The printer 200 sets a variable C of the number of images to be includedon one page to “0” (step S102), and determines whether an image is inputfrom the digital still camera 100 (step S103). When the result of thedetermination made at step S103 is YES, the printer 200 adds “1” to thevariable C (step S104), positions the input image on a page according toCth layout data (layout data #C), and issues a depicting command to alower processing layer (step S105).

The printer determines whether the variable C reached a number N ofimages that can be included in one page (step S106). When the result ofthe determination made at step S106 is NO, the system control returns tostep S103, and determines whether a next image is input.

When the digital still camera 100 finishes inputting images to theprinter 200, and the result of the determination made at step S103 isNO, the printer 200 determines whether the variable C is more than “0”(step S107). When the result of the determination made at step S107 isNO, the image printing processing ends.

When the printer 200 finishes depicting images for one page and theresult of the determination made at step S106 is YES, or when thedigital still camera 100 finishes inputting images to the printer 200but the last page is not discharged and the result of the determinationmade at step S107 is YES, the processing proceeds to step S108. At thispoint, the variable C retains the number of images to be included on thepage to be printed out.

At step S108, the printer 200 sets a variable i to “0”. The variable iis used for sequentially scanning all the depicting data included in theform additional data. The printer 200 acquires an i-th element in thedepicting data, and determines whether the image index value of theacquired element is smaller than the variable C (step S109).

When the result of the determination made at step S109 is YES, theprinter 200 issues, to a lower processing layer, a depicting command todepict the contents of the i-th element (step S110). When the result ofthe determination made at step S109 is NO, step S110 is not performed.

The printer 200 adds “1” to the variable i (step S111), and determineswhether processings for all depicting data are completed (step S112).When the result of the determination made at step S112 is NO, the systemcontrol returns to step S109, and performs processings for remainingdepicting data.

When the result of the determination made at step S112 is YES, theprinter 200 discharges the depicted page (step S113), returns to stepS103, and performs processings for a next page.

Similar results can be obtained by replacing the digital still camera100 with a digital video camera having a function of a digital stillcamera. Moreover, similar results can be obtained by replacing thedigital still camera 100 with a mobile terminal having a function of adigital still camera.

It is sufficient that the images are available, and it is not necessarythat the images be taken with a camera. In other words, the images canbe images prestored in a hard disk of a computer, or can be imagesscanned with a scanning function of a scanner, a composite machine, or acopier. The images can also be downloaded via a network such as theInternet. In other words, instead of connecting the printer 200 to thedigital still camera 100 as shown in FIG. 1, the printer 200 can beconnected to a computer having a hard disk with prestored images or acommunication function that allows downloading of images via a network,or the printer 200 can be connected to, or incorporated in, a scanner, acomposite machine, or a copier.

Although the invention has been described with respect to a specificembodiment for a complete and clear disclosure, the appended claims arenot to be thus limited but are to be construed as embodying allmodifications and alternative constructions that may occur to oneskilled in the art that fairly fall within the basic teaching herein setforth.

1. An image processing device comprising: a storing unit that stores atleast one form data, a plurality of image data, and at least one formatdata; a selecting unit that selects a form data and a format data fromamong the form data and the format data stored in the storing unit basedon number of image data; and an image combining unit that combines theimage data, selected form data and format data to generate an outputimage.
 2. The image processing device according to claim 1, wherein theformat data includes layout data that specifies positional informationof the image data on a page, and additional data about depictingelements added on the output image.
 3. The image processing deviceaccording to claim 2, wherein the additional data includes variable datathat is added on the output image at an arbitrary position inassociation with the image data, and fixed data that is added on theoutput image at a fixed position.
 4. The image processing deviceaccording to claim 3, wherein the variable data and the fixed datainclude at least one of character depicting data for adding figures andcharacters, line depicting data for adding a line element, graphicdepicting data for adding a graphic element, and image depicting datafor adding an image element on the output image.
 5. The image processingdevice according to claim 1, further comprising an image receiving unitthat receives image data from outside and stores received image data inthe storing unit.
 6. The image processing device according to claim 1,further comprising an image capturing unit configured to capture imagesand that stores image data corresponding to captured images in thestoring unit.
 7. The image processing device according to claim 1,further comprising an image scanning unit configured to scan images andthat stores image data corresponding to scanned images in the storingunit.
 8. A method of combining an image and a form, comprising:receiving a plurality of image data; selecting a form data from among atleast one form data and a format data from among at least one formatdata based on number of the image data; and combining the image data,selected form data and format data to generate an output image.
 9. Themethod according to claim 8, wherein the format data includes layoutdata that specifies positional information of the image data on a page,and additional data about depicting elements added on the output image.10. The method according to claim 9, wherein the additional dataincludes variable data that is added on the output image at an arbitraryposition in association with the image data, and fixed data that isadded on the output image at a fixed position.
 11. The method accordingto claim 10, wherein the variable data and the fixed data include atleast one of character depicting data for adding figures and characters,line depicting data for adding a line element, graphic depicting datafor adding a graphic element, and image depicting data for adding animage element on the output image.
 12. The method according to claim 8,wherein the receiving includes receiving the image data from outside.13. The method according to claim 8, further comprising capturingimages, wherein the receiving includes receiving image datacorresponding to captured images.
 14. The method according to claim 8,further comprising scanning images, wherein the receiving includesreceiving image data corresponding to scanned images.
 15. An imageforming device comprising: a storing unit that stores at least one formdata, a plurality of image data, and at least one format data; aselecting unit that selects a form data and a format data from among theform data and the format data stored in the storing unit based on numberof image data; an image combining unit that combines the image data,selected form data and format data to generate an output image; and anoutputting unit that outputs the output image.
 16. The image formingdevice according to claim 15, further comprising an image receiving unitthat receives image data from outside and stores received image data inthe storing unit.
 17. The image forming device according to claim 15,wherein the format data includes layout data that specifies positionalinformation of the image data on a page, and additional data aboutdepicting elements added on the output image.
 18. The image formingdevice according to claim 17, wherein the additional data includesvariable data that is added on the output image at an arbitrary positionin association with the image data, and fixed data that is added on theoutput image at a fixed position.
 19. The image forming device accordingto claim 18, wherein the variable data and the fixed data include atleast one of character depicting data for adding figures and characters,line depicting data for adding a line element, graphic depicting datafor adding a graphic element, and image depicting data for adding animage element on the output image.
 20. The image forming deviceaccording to claim 15, further comprising an image capturing unitconfigured to capture images and that stores image data corresponding tocaptured images in the storing unit.
 21. The image forming deviceaccording to claim 15, further comprising an image scanning unitconfigured to scan images and that stores image data corresponding toscanned images in the storing unit.
 22. A printing system comprising: animage capturing unit configured to capture images; and a printing unitthat includes a storing unit that stores at least one form data, aplurality of image data corresponding to images captured by the imagecapturing unit, and at least one format data; a selecting unit thatselects a form data and a format data from among the form data and theformat data stored in the storing unit based on number of image data; animage combining unit that combines the image data, selected form dataand format data to generate an output image; and an outputting unit thatoutputs the output image.
 23. The printing system according to claim 22,wherein the format data includes layout data that specifies positionalinformation of the image data on a page, and additional data aboutdepicting elements added on the output image.
 24. The printing systemaccording to claim 23, wherein the additional data includes variabledata that is added on the output image at an arbitrary position inassociation with the image data, and fixed data that is added on theoutput image at a fixed position.
 25. The printing system according toclaim 24, wherein the variable data and the fixed data include at leastone of character depicting data for adding figures and characters, linedepicting data for adding a line element, graphic depicting data foradding a graphic element, and image depicting data for adding an imageelement on the output image.